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Abstract: This paper considers the distributed robust control problems of uncertain linear multi-agent systems 
with undirected communication topologies. It is assumed that the agents have identical nominal dynamics 
while subject to different norm-bounded parameter uncertainties, leading to weakly heterogeneous multi-agent 
CN ' systems. Distributed controllers are designed for both continuous- and discrete-time multi-agent systems, based 

on the relative states of neighboring agents and a subset of absolute states of the agents. It is shown for both 
' the continuous- and discrete-time cases that the distributed robust control problems under such controllers in 

[~^. ' the sense of quadratic stability are equivalent to the Hoc control problems of a set of decoupled linear systems 

having the same dimensions as a single agent. A two-step algorithm is presented to construct the distributed 
controller for the continuous-time case, which does not involve any conservatism and meanwhile decouples the 
feedback gain design from the communication topology. Furthermore, a sufficient existence condition in terms of 
linear matrix inequalities is derived for the distributed discrete-time controller. Finally, the distributed robust 
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control problems of uncertain linear multi-agent systems subject to external disturbances are discussed. 
Keywords: Multi-agent system, distributed control, robustness, Hoo control, parameter uncertainty. 

'■ 1 Introduction 

cn 

The coordination control problems of multi-agent systems have received increasing attention from 
various scientific communities, for its broad applications in such fields as satellite formation flying, 
sensor networks, and air traffic control, to name just a few pQ. Due to the spatial distribution of 
actuators, communication constraint, and limited sensing capability of sensors, centralized controllers 
$_i ' are generally too expensive or even infeasible to implement in practice. Therefore, distributed control 

strategies based on only local information have been proposed and extensively studied in the last 
decade. 

Formation control of multiple autonomous vehicles is considered in [2] , where a Nyquist-like criterion 
is derived. Distributed linear quadratic regulator (LQR) control of a set of identical decoupled dynam- 
ical systems is discussed in [3j. A decomposition approach is proposed in [4] to solve the distributed 
.ffoo control of identical coupled linear systems. A general framework of the consensus problem for 
networks of integrator agents with fixed and switching topologies is addressed in [5]. The conditions 
derived in [S] are further relaxed in [B] . The consensus problems of networks of double- and high-order 
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integrators are investigated in [9]. Consensus algorithms are designed in |10[ [TT] for a group 
of agents with quantized communication links and limited data rate. Distributed consensus control 
of multi-agent systems with general linear dynamics is studied in [12[ [T3"l [HI I15j . Distributed 
consensus and control problems are investigated in |16[ [T7] for networks of agents subject to exter- 
nal disturbances and model uncertainties. Flocking algorithms are studied in |18[ [T9] for a group of 
autonomous agents. 

The aforementioned works have a common assumption that the dynamics of the agents are all 
identical, i.e., the multi-agent systems are homogeneous. Such an assumption may be restrictive in 
many circumstances. It is necessary and important to study the cooperative control problems of 
heterogenous multi-agent systems consisting of nonidentical agents. Previous works along this line 
include [201 1211 1221 [221 121] ■ Specifically, scalar robust stability conditions are derived in [201 121] for a 
network of heterogeneous agents by using the notion of S-hull. Similar results are given in [22] using 
tools from the integral quadratic constraint (IQC). In [23] , a distributed controller based on the internal 
model is designed for the output regulation of heterogeneous linear multi-agent systems. Neural 
adaptive tracking control of first-order nonlinear systems with unknown dynamics and disturbances 
is investigated in [23] , 

This paper is concerned with the distributed robust control problems of multi-agent systems with 
general linear dynamics subject to norm-bounded parameter uncertainties. It is assumed that all 
the agents have the same nominal dynamics but subject to different parameter uncertainties. Thus, 
the resulting multi- agent systems are weakly heterogeneous, which fits well into the gap between the 
commonly-studied homogeneous multi-agent systems and the heterogeneous multi-agent systems as 
investigated in |20[ [2T| [22]. Typical examples belonging to this scenario are the mass-spring systems 
[25| with different or uncertain spring constants, the Lorenz-type chaotic systems that cover the Lorenz, 
Chen, Lii systems as special cases with the change of a key parameter [26] . and the discrete-time double 
integrators with unknown model parameters which have applications in synchronization of a network 
of clocks [27]- 

In this paper, distributed controllers are proposed for both the continuous- and discrete-time un- 
certain multi-agent systems, which rely on the relative states between neighboring agents and the 
absolute states of a subset of the agents. It is shown for both the continuous- and discrete-time cases 
that the distributed robust control problems under such controllers in the sense of quadratic stability 
(which are referred to as distributed quadratic stabilization problems) are equivalent to the i^oo con- 
trol problems of a set of decoupled linear systems having the same dimensions as a single agent. A 
two-step algorithm is presented to construct the distributed controller for the continuous-time case, 
which decouples the feedback gain design from the communication topology and does not involve any 
conservatism. The maximal allowable uncertainty bound is given as a corollary. A sufficient existence 
condition in terms of linear matrix inequalities is further derived for the distributed discrete-time 
controller. Note that such a condition is conservative to some extent, because the eigenvalues of the 
stochastic matrix associated with the communication graph are treated as an uncertainty. Moreover, 
distributed quadratic stabilization with disturbance attenuation is considered for uncertain linear 
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multi-agent systems subject to external disturbances, which can be reduced to the scaled control 
problems of a set of independent systems whose dimensions are equal to that of a single agent. Design 
procedures for distributed controllers are further given for both the continuous- and discrete-time 
cases. 

The rest of this paper is organized as follows. Some basic notation and useful results of the graph 
theory are reviewed in Section 2. The distributed robust control problems of continuous- and discrete- 
time multi-agent systems are investigated in, respectively, Sections 3 and 4. Simulation examples are 
given for illustration in Section 5. Conclusions are drawn in Section 6. 

2 Graph Theory and Notation 

Let R nxn be the set of n x n real matrices. The superscript T means the transpose for real ma- 
trices. In represents the identity matrix of dimension N. Matrices, if not explicitly stated, are 
assumed to have compatible dimensions. Denote by 1 the column vector with all entries equal to one. 
diag(^4i, • • • , A n ) represents a block-diagonal matrix with matrices Ai,i = 1, • • • ,n, on its diagonal. 
The matrix inequality A > B (respectively, A > B) means that A — B is positive definite (respec- 
tively, positive semi-definite). A<g>B denotes the Kronecker product of matrices A and B. A matrix is 
Hurwitz (in the continuous-time case) if all of its eigenvalues have negative real parts, while is Schur 
stable (in the discrete-time case) if all of its eigenvalues have magnitude less than 1. 

An undirected graph Q is a pair (V,£), where V = {v±, ■ ■ ■ ,v m } is the set of nodes and £ C V x V 
is the set of unordered pairs of nodes, called edges. Two nodes Vi, Vj are adjacent, or neighboring, if 
(vi,Vj) is an edge of graph Q. A path on Q from node to node is a sequence of ordered edges of 
the form (vi k , Vi k+1 ), k = 1, • • • ,1 — 1. A graph is called connected if there exists a path between every 
pair of distinct nodes, otherwise is disconnected. 

The adjacency matrix A = [dij] € j^ mxm associated with the undirected graph Q is defined by 
an = 0, ciij = aji = 1 if € £, and aij = a,ji = otherwise. The Laplacian matrix C € R mxm 

is defined as Cn = X]jyj a y an d = —o-ij, i 7^ j- Let V = [dij] 6 R mxm be a double-stochastic 
matrix associated with Q with the additional assumption that da > 0, dij = dji > if £ £ and 
d^ = dji = otherwise. It is straightforward to verify that zero is an eigenvalue of C with 1 as the 
corresponding eigenvector and all nonzero eigenvalues are positive. One is an eigenvalue of T> with 1 
as the corresponding eigenvector and all other eigenvalues of T> are in the open unit disk [6]. 

3 Distributed Robust Control of Uncertain Continuous-Time Multi- 
Agent Systems 

3.1 Distributed Quadratic Stabilization 

Consider a network consisting of iV continuous-time linear agents subject to parameter uncertainties, 
described by 

xi = (A + AAi)xi + Bu^ i = l,---,N, (1) 



3 



where X{ £ R n and Uj € R m are, respectively, the state and the control input of the i-th agent, 
A and B are constant matrices with compatible dimensions, and AAi is an unknown matrix which 
represents the time-varying uncertainty associated with the i-th agent and is assumed to be in the 
form of AAi = DFiE, where Fi £ IV xk is the uncertainty satisfying 

F?Fi<6 2 I, i = l,---,N, (2) 

with elements of Fi being Lebesgue measurable and 5 > a given constant, and D and E are known 
constant matrices which characterize the structure of the uncertainty. 

The communication topology among the N agents is represented by an undirected graph Q. It 
is assumed here that only a subset of agents know their own states but each agent can measure 
the relative states with respect to its neighbors. Without loss of generality, assume that the first q 
(1 < q < N) agents have access to their state information. 

The following assumption will be used in the sequel. 

Assumption 1. The undirected communication graph Q is connected and at least one agent knows 
its own state. 

Based on the relative state information between neighboring agents and the absolute states of a 
portion of agents, a distributed controller is proposed as 

/N \ 

Ui = cK I (Hj(xi - Xj) + diXi J , i = 1, ■ ■ ■ , TV, (3) 

where c > € R is the coupling strength, K € R mxn is the feedback gain matrix, ajj is the (i,j')-th 
entry of the adjacency matrix A associated with Q, and d% are constant scalars, satisfying di > 0, 
i = 1, ■ ■ ■ ,q, and dj = 0, i = q + 1, ■ ■ ■ ,N. 

Let x = [xf ', • • • , xJf] T and D = diag(di, • • • , djv)- Then, the closed-loop network dynamics resulting 
from dH) and ([3]) can be rewritten as 

x= (l N ® A + cC ® BK + (I N (g> D)A(I N EU x, (4) 

where C = C + D, C is the Laplacian matrix of Q, and A = diag(i ? i, • • • , -F/v). 
First, the notion of quadratic stability is introduced. 

Definition 1 [2S\ 129] . The system ([T]) with ttj = is quadratically stable if there exists a positive- 
definite matrix P such that for all admissible uncertainty AAi, 

P(A + AAi) T + (A + AAi)P < 0. 

The objective in this section is to design a distributed controller Q such that the closed- loop 
network @ is quadratically stable for all admissible uncertainties AAi, i = 1, • • • , N. This problem 
is referred to as distributed quadratic stabilization problem. 

Lemma 1 [29]. The system (pQ) with Ui = is quadratically stable for all admissible uncertainties 
Fi satisfying ([2]) if and only if A is Hurwitz and \\E(sI — A)~ 1 D\\ OQ < I. 

Lemma 2 |3U[ I14j. For a graph Q satisfying Assumption 1, the matrix C in ^ is positive definite. 
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The following presents a necessary and sufficient condition for the distributed quadratic stabilization 
problem. 

Theorem 1. Under Assumption 1, the closed-loop network is quadratically stable for all admis- 
sible uncertainties Fi, i = 1, ■ ■ ■ ,N, satisfying ([5]), if and only if the matrices A + c\BK are Hurwitz 
and ||Tk(s)||oo < y, * = 1, ■ ■ ■ , N, where Ti(s) = E(sl - A — c\iBK)~ l D, i = 1, ■ ■ ■ ,N, and A*, 
i = 1, • • ■ ,N, are the eigenvalues of C. 

Proof. (Necessity) Consider a special case where the certainties in ([TJ are the same, i.e., F± = ■■■ = 
Fn = F. Thus, the system @ can be rewritten as 

x= (i n ®A + c£®BK + I n ®DFE)x. (5) 

Because Assumption 1 holds, it follows from Lemma 2 that £ is positive definite. Let U € Yi NxN be 
such a unitary matrix that U T CU = A = diag(Ai, • • • , Ajv). Let £ = ■ ■ ■ ,£, N ] T = {U ® I n )£- Then, 
it follows from ([5]) that 

£ = (I N <g> A + cA ® BK + I N ® DFE)£. (6) 

Note that the state matrix of ([U]) is block diagonal. Therefore, the network (0) is quadratically stable 
if and only if the following iV systems: 

i i = (A + cX i BK + DFE)d, i = l,---,N, (7) 

are simultaneously quadratically stable, which by Lemma 1 implies that A + c\{BK are Hurwitz and 
||T i ( a )|| 0O < J,i = l,-.. ,N. 

(Sufficiency) From ([2]), it follows that the uncertainty A in satisfies A T A < 5 2 F In light of 
Lemma 1, the system (j4|) is quadratically stable for all admissible uncertainties Fi, i = 1, • • • , JV, 
satisfying ([2]), if In ® A + cC ® BK is Hurwitz and HT^s)^ < 4, where 

T{s) ^{I N ®E)(sI -I N ®A-c£® BK^j (I N ®D). (8) 

Note that 

(U ® I n )T(s)(U T <8> /„) = (/tv ® (sJ - /jv ® ^ - cC/ T £C/ ® W)~ (Jiv ® £>) 

= (Jjv ® £) (si - I N ® A - cA ® ^i-Q" 1 (/at ® D) ( 9 ) 
= diag(Ti(s),--- ,T N (s)). 

By the definition of the norm [31], it follows readily from ([9|) that 

ll T (s)lloo = . max ||Ti(s)||oo. 

1=1,— ,JV 

Therefore, if the matrices A + c\BK are Hurwitz and (s) || oo < t 5 * = lj ■ ■ ■ > JV", then the system 
@ is quadratically stable for all admissible uncertainties i^, i = 1, • • • , N, satisfying ([2]). ■ 
Remark 1. Although the uncertainty A in @ is structural, it is shown in Theorem 1 that the 
distributed quadratic stabilization problem of (j3|) is equivalent to the -Hoc control problems of a set 
of decoupled linear systems having the same dimensions as a single agents, which is essentially due to 
the fact that the nominal dynamics of the agents are identical. 
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Remark 2. Different from most of the existing references focusing on homogeneous multi-agent 
systems, the current paper considers the uncertain multi-agent systems where the agents have the same 
nominal dynamics but subject to different parameter uncertainties. The resulting agent network Q is 
thus weakly heterogeneous, which fits well into the gap between the commonly-studied homogeneous 
multi-agent systems and the heterogeneous multi-agent systems as investigated in \20\ [2T| [22| 123] . 
Typical examples belonging to this scenario are the mass-spring systems [25] with different or uncertain 
spring constants, the Lorenz-type chaotic systems [26], and the discrete-time double integrators with 
unknown model parameters |27j . 

Next, an algorithm is presented to determine the distributed controller ([3]). 

Algorithm 1. Under Assumption 1, a distributed controller ([3]) can be constructed as follows: 



1) Solve the following linear matrix inequality (LMI): 

SD PE T ~ 

< (10) 



AP + PA T -tBB t SD PE T 
SD T -I 

EP -I 



to get a matrix P > and a scalar r > 0. Then, choose K = —^B T P 1 . 
2) Select the coupling strength c > cth, where 

cth = ■ T 77 v - (11) 

mm (Aj) 

Theorem 2. Under Assumption 1, the closed- loop network with the distributed controller 
constructed by Algorithm 1 is quadratically stable for all admissible uncertainties Fi, i = 1, • • • ,N, 
satisfying ([2]). 

Proof. By the Schur Complement Lemma [32], the LMI (110p is feasible for some matrix P > and 
scalar r > if and only if the following Riccati inequality holds: 

AP + PA T - tBB t + 5 2 DD T + PE T EP < 0. (12) 

From step 2) in Algorithm 1, it follows that cAj > r, i = 1, • • ■ ,N. Noting K = — ^B T P _1 , it can be 
obtained that 

(A + c\iBK)P + P(A + c\iBK) T + 5 2 DD T + PE T EP 

= AP + PA T - c\iBB T + 5 2 DD T + PE T EP (13) 
< 0. 

By the Bounded Real Lemma [31] . it follows from f)13|) that A + c\BK are Hurwitz and ||Ti(s)||oo < j> 
i = 1, • • • , N. Therefore, Theorem 1 implies that the network in this case is quadratically stable 
for all admissible uncertainties Fi, i = 1, • • • , N, satisfying ([2]). ■ 
Remark 3. As shown in the proof of Proposition 1 in p3], by using Finsler's Lemma [33], it is not 
difficult to see that there exist P > and r > such that (|10p holds if and only if there exists a K 
such that (A + BK)P + P(A + BK) T + 5 2 DD T + PE T EP < 0. That is, A + BK is Hurwitz and 
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\\E(sI — A — BK)~ l D\\ oa < i. Therefore, it follows from Theorems 1 and 2 that the feasibility of the 
LMI (I10p with respect to P > and r > is not only sufficient but also necessary for the existence of 
a controller ([3]) satisfying Theorem 1. The largest allowable uncertainty bound <5 max can be obtained 
by the following optimization problem: 

maximize <5 > 

™ (14) 
subject to LMI (TOD, witn P > 0, r > 0. 

3.2 Distributed Quadratic Control 

This subsection extends to consider a network of uncertain linear agents subject to external distur- 
bance, given by 

±i = (A + AAi)xi + Bui + B 2 u)i, 

(15) 

Zi = Cxi, i = 1, • • ■ , 2V, 

where 0Ji € R p and Zi £ R' are, respectively, the exogenous disturbance and the performance variable 
of the i-th agent, and the rest of the variables are defined as in (TJ. 

The distributed controller is still given as in ©. Let co = [loJ, ■ ■ ■ ,ujJf] T and z = [zf , • • • , zJf] T . 
Then, the closed-loop system resulting from (|15p and (3D can be written as 

x= (l N ®A + cZ®BK + (I N ® D)A(I N (g)E)) x + (I N <g> B 2 )u, 

V ' (16) 

Z = (I N ® C)x. 

This section is to design a distributed controller (3D such hat the closed-loop system (TOP is quadrat- 
ically stable and meanwhile achieves a prescribed level of disturbance attenuation in the H^-noxva. 
sense for all admissible uncertainties Fi, i = 1, • • ■ ,N, satisfying 0. 

Definition 2 [29] . The system (|15p with m = is quadratically stable with a disturbance attenuation 
level 7 > if there exists a positive-definite matrix P such that for all admissible uncertainty AAi, 

P(A + AA,) T + (A + AAi)P + X}B 2 B% + PC T CP < 0. 
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Lemma 3 [29] . There exists a positive-definite matrix P such that 

P(A + HiFi£i) T + (A + FiFiEi)P < 

for all admissible uncertainty -Fi(t) satisfying Fi F\ < g 2 / if and only if there exists a scalar e > 
such that 

PA T + AP + ^PEfEiP + eg 2 HtHf < 0. 

Theorem 3. Suppose that Assumption 1 holds. Then, the closed-loop network (|16p is quadratically 
stable with disturbance attenuation 7 > for all admissible uncertainties Fi, i = 1, ■ • ■ , N, satisfying 
(2D, if the following systems: 



±i = (A + c\iBK)xi + 



Zi 



e~zE 
C 



ez5D 7 1 B 2 Wi 

(17) 

, • • • , N, 
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are simultaneously asymptotically stable with unitary disturbance attenuation, where X{ € R n , a), € 
R p+J , Zi € R /+fc , and e > is a scalar to be chosen. 

Proof. As stated in the proof of Theorem 1, the uncertainty A in (|16p is structural and satisfies 
A T A < 5 2 I. In view of Definition 2, the network (|16|) is quadratically stable with disturbance 
attenuation 7 > for all admissible uncertainties Fi, i = 1, • • • ,N, satisfying ([2]), if there exists a 
positive-definite matrix V £ R NnxNn such that 

VS T + SV + -^B 2 B% + VC T CV < 0, (18) 

where 

S = I N ®A + cC®BK+{I N ® D)A(I N <g> J5), 
B 2 = I N ®B 2 , C = I n ®C. 

Let £7 € R A?xAr be such a unitary matrix that U T CU = A = diag(Ai, • • • , Xn)- Multiplying the left 
and right sides of (fT8|) by U T <g> 7 n and U <S> I n , respectively, gives 

P5 T + SP + ^S 2 i3j + VC T CV < 0, (19) 

T 

where 

5 = /at ® -4 + cA ® M + (/at <g> D)A(I N <g> E), 
A = (f/ T <g> J n )A([7 J n ), p = (C/ r ® I n )P(C7 I n ). 
Clearly, it follows from ([2]) that A satisfies 

A T A = (U T ® I n )A T A{U ® /„) < <5 2 /. 

By Lemma 3, it follows that (|19p holds if there exists a scalar e such that 



P(Jjv ® i4 + cA ® BK) T + {I N ®A + ck® BK)V + -P(I]v ® E T E)V 

+e5 2 I N ® DD T + -^S 2 &T + PC T CP < 0. 

7^ 



(20) 



Note that all the matrices in (|20p except V are block diagonal. Therefore, if there exist positive-definite 
matrices Pj G R nxn such that 

Pi(A + cXiBKf + (A + c\iBK)Pi + -PiE T EPi + e5 2 DD T 

I,. -t 6 (21) 

+-^2^ + PiC T CPi < 0, i = 1, • • • , AT, 

7^ 

then the matrix V = (U ® I n )diag(Pi, • • • , Pn)(U t <g) /«) satisfies (JTHJ). By the Bounded Real Lemma 
[31 j ^ it is easy to see that (|2ip is equivalent to that the N systems in ()17|) are simultaneously asymp- 
totically stable with unitary disturbance attenuation. This completes the proof. ■ 

Remark 4. Theorem 3 casts the robust control problem of high-dimensional network (|16j) to 
the scaled control problems of a set of independent low-dimensional linear systems in (|17p , thereby 
reducing the computational complexity significantly. When the external disturbances uji do not exist, 
Theorem 3 is reduced to Theorem 1. 

Algorithm 2. Under Assumption 1, a distributed controller ^ can be constructed as follows: 
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1) Solve the following LMI: 

<A T -fBB T + ^B 2 BT + e5 2 DD T QC T QE T ~ 

< (22) 



CQ -I 

EQ -el 

to get a matrix Q > and scalars f > 0, e > 0. Then, choose K = —\B T Q~ X . 

2) Select the coupling strength c > c t h, where c t h is defined in (fTT|) . 

Remark 5. It is worth noting that in Algorithms 1 and 2, the feedback gain design of (J3j) is 
decoupled from the communication topology and only the smallest eigenvalue of C is used to select 
the coupling strength c. One consequence of this decoupling property is that the controller designed 
for one given connected communication graph can be used directly to any other connected graphs, with 
the only task of appropriately selecting the coupling strength c. By selecting the coupling strength c 
to be relatively large, the distributed controller ([3|) constructed by these algorithms maintains certain 
degree of robustness with respect to variations of the communication graph Q, such as adding or 
removing edges or agents in Q, in which case although the eigenvalues Aj, i = 1, • • • , N, are changed, 
cAj, i = 1, • • • , N, can still be larger than r (or f). 

Theorem 4. Suppose that Assumption 1 holds. Then, the closed-loop network ()16p with the dis- 
tributed controller (|3|) constructed by Algorithm 2 is quadratically stable with disturbance attenuation 
7 > for all admissible uncertainties AAi, i = 1, • • • ,N, satisfying @ 

Proof. The proof is similar to that of Theorem 2 and thus is omitted. ■ 

Corollary 1. As 7 — > 00, the LMI condition (|22|) in Algorithm 2 is reduced to ([10p in Algorithm 1. 

Proof. By the Schur Complement lemma |32j, the LMI (|22|) is equivalent to 

QA T + AQ- fBB T + X;B 2 Bl + e5 2 DD T + -QE T EQ + QC T CQ < 0. 

7 Z e 



Letting Q = jP, e = 7 , and f = 7 1 t gives 



PA T + AP- tBB t + -B 2 bT + 5 2 DD T + PE T EP + -PC T CP < 0. 

7 7 



(23) 



When 7 — > 00, (|23|) implies that 



+ AP - r££ T + 8 2 DD T + PE T EP < 0, 
which is equivalent to (fTU|) , ■ 

4 Distributed Robust Control of Uncertain Discrete-Time Multi- 
Agent Systems 

This section considers a network consisting of N discrete-time agents with parameter uncertainties, 
described by 

Xi(k + l) = (A + AAi)xi(k) + Bui(k), i = l,---,N, (24) 
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where Xi{k) 6 R n and ui{k) £ R m are, respectively, the state and the control input at the k time 
instant of the i-th agent, and AAi denotes the time- varying uncertainty associated with the i-th agent, 
which is assumed to be in the form of AAi = DFiE, with Fi € R jxfc satisfying ([2]). 

Similar to @, a distributed controller based on the relative states between neighboring agents and 
the absolute states of a subset of agents is proposed as 

Ui{k) = K \Y^ eij (xi(k) - Xj (k)) + diXi(k)j , i = l,---,N, (25) 

where K 6 R mxn is the feedback gain matrix, c%j is the (i, j')-th entry of the double-stochastic matrix 
T> associated with Q, and di are constant scalars, satisfying en > di > 0, i = 1, ■ ■ ■ , q, and di = 0, 
i = q+l,--- ,N. 

Let x = [xf , ■ ■ ■ , xJ^] T and D = diag(dli, • • • , d]y)- Then, the closed-loop network dynamics resulting 
from (|24p and (|25p can be rewritten as 

x(k + 1) = (l N ® A + (I N -V)®BK + (I N D)A{I N ® S)) x(/e), (26) 

where V = V - D and A = diag(Fi , • • • , F N ). 

The objective in this section is to solve the discrete-time distributed quadratic stabilization prob- 
lem for (|26p . i.e., to design a distributed controller (|25p such that the closed- loop network j26j) is 
quadratically stable for all admissible uncertainties AAi, i = 1, ••■ , iV. 

The notion of quadratic stability for (|24p is introduced below. 

Definition 3 |34| . The system (|24|) with itj = is quadratically stable if there exists a positive- 
definite matrix P such that for all admissible uncertainty AAi, 

(A + AAi) T P(A + AAj) - P < 0. 

Lemma 4 [34] . The system ()24|) with m = is quadratically stable for all admissible uncertainties 
Fi satisfying © if and only if A is Schur stable and \\E(zI — A^DW^ < j. 

Lemma 5. Suppose that the graph ^ satisfies Assumption 1. Then, the matrix T> in (|26p have all 
of its eigenvalues located inside the unit circle. 

Proof. Consider the following new row-stochastic matrix: 

_ r v di n 

v = 

According to the definition of the directed spanning tree [6], the graph associated with T> has a directed 
spanning tree if Q satisfies Assumption 1. Therefore, by Lemma 3.4 in [6], if Assumption 1 holds, 
then 1 is a simple eigenvalue of T> and all the other eigenvalues of T> are in the open unit disk, which 
further implies that all the eigenvalues of T> lie in the open unit disk. ■ 
The following gives a sufficient condition for solving the distributed quadratic control problem of 

(IMl). 

Theorem 5. Under Assumption 1, the closed-loop network (|26p is quadratically stable for all 
admissible uncertainties Fi, i = 1, • • • , N, satisfying ([2]), if and only if the matrices A + (1 — \i)BK 
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are Schur stable and H^O)^ < ±, i = 1, • • • , N, where fi(z) = E(zl - A - (I - X^BK^D, 
i = 1, • • • ,N, and Aj, i = 1, • • ■ , N, are the eigenvalues of V. 

Furthermore, if there exist matrices Q > 0, W, and a scalar r such that 

-Q (AQ + BW) T QE T W T 

AQ + BW -Q + 5 2 DD T + tk 2 BB t 

EQ -10 

W -t/ 



<0, 



(27) 



where k = max |Aj|, then there exists a distributed controller (|25p such that (|26p is quadratically 
stable. Specifically, the feedback gain matrix of (|25j) is given by K = WQ" 1 . 
Proof. The equivalence between the quadratic stability of fj26p and ||7^(^)||oo 

< | can be checked 

by following similar steps in the proof of Theorem 1. Next, it will be shown that the feasibility of the 
LMI (|27p guarantees the existence of a controller (I25p satisfying the quadratic stability of (|26|) . In 
virtue of the discrete-time Bounded Real Lemma [31], the matrices A + (1 — \)BK are Schur stable 
and HTj^Hoo < 4, i = 1, • • ■ , N, if and only if there exist matrices Pi > such that 



A 1 P{ A -Pi + E 1 E + 5 2 A T PiD(I - FDPi&Y^DPiA < 0, i = 1 



Tn-1 



(28) 



where i = ^ + (1 - X^BK. Noting that |A;| < K, i = 1, • • • , N, (J2B]| clearly hold for i = 1, • • • , iV, if 
there exists a P > such that 



A T PA -P + E T E + 5 2 A T PD(I - 5 2 DPD T y 1 DPA < 0, 



(29) 



where A = A + (1 — A)BK, for all |A| < k. It is not difficult to see that (|29p can be rewritten as 

A T {P~ l - 5 2 DD T )~ l A -P + E T E < 0. 

By letting Q = P~ l and applying the Schur Complement Lemma [32] . the above inequality is equiv- 
alent to 

" -Q- 1 A T E T ~ 
A Q- 5 2 DD T 
E -I 



< 0, 



which can be rewritten as 



-Q- 1 


{A + BKf 


E T ~ 







A + BK 


Q - 6 2 DD T 





+ 


B 


E 





-I 








K 



+ 



K T 





A 



B T 



< 0. 



Using Lemma 3, (|3Up holds if and only if 



-Q- 1 (A + BK) T E T K T 

A + BK Q - 5 2 DD T + tk 2 BB t 

E -10 

K -tI 



<0, 



(30) 



(31) 
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for some scalar r. Multiplying the both sides of (|3ip by diag(Q, /, /, I) and noting W = KQ leads 
directly to fl27J). ■ 
Remark 6. By similar steps in proving Corollary 1, it is not difficult to show that the LMI condition 
(1271) is equivalent to \\K{zI - A- BK)- l B\\ oo < i, when 5 — > 0, i.e., the uncertainty bound is 
sufficiently small. As pointed out in |34[ [35] , a sufficient condition for the existence of K satisfying 
H-KX-zI — A — B^^^-BWoa < i is that (A,B) is stabilizable and k < n |A"04) ' wnere ^t(A) are the 



unstable eigenvalues of A. Therefore, under such a condition, the LMI (|27p is feasible for the case 
where the uncertainty bound in ([2]) is sufficiently small. The largest allowable uncertainty bound <5 max 
can be obtained by maximizing 5 in (|27D . 

Remark 7. Theorem 5 involves certain conservatism, which is introduced by treating the eigenvalues 
Aj, i = 1,2, ••■ , A, as uncertainties with the bound k. By selecting k to be relatively large, the 
distributed controller (|25p constructed by Theorem 5 maintains certain degree of robustness with 
respect to variations of the communication graph Q, such as adding or removing edges in Q. 

Next, consider a network of uncertain discrete-time agents subject to external disturbance, given 

by 

Xi (k + 1) = (A + AAi)xi(k) + Bui(k) + B 2 0Ji{k), 
Zi (k + l) = Cxi(k), i = l,---,N, 

where ojj € R p , z,- L G R', and the rest of the variables are defined as in (f2l 

Let w = [wj 1 , • • • , coJf) T and ; 
loop system can be written as 

x(k + 1) = (j N ® A + (Ijv -V)®BK + (Jjv (8) D)A(I N ® ) x(fe) + (Jjy » B 2 )w(A;), 

Z (A; + 1) = (/jy (g) C)x(k). 



(32) 



[zf , • • • , z^] T . Then, it follows from ([32]) and ([25]) that the closed- 



(33) 



Theorem 6. Suppose that Assumption 1 holds. Then, the closed-loop network (j!6p is quadratically 
stable with disturbance attenuation 7 > for all admissible uncertainties Fi, i = 1, • • • , N, satisfying 
([2]), if the following systems: 



+ 1) = {A + {l-\ i )BK)x i {k) + 



ez5D ~f- L B 2 



U>i(k), 



Zi(k + 1) 



C 



,N, 



are simultaneously asymptotically stable with unitary disturbance attenuation, where Xi € H r 
W +j , Zi G R /+fc , and e > is a scalar to be chosen. 

Further, if there exist matrices Q > 0, W, and a scalar r such that 



(34) 



LUi G 



-Q 


(AQ + BW) T 


QE T 


QC T 


W T 


AQ + BW 


-Q + 5 2 DD T + tk 2 BB t 











EQ 





-el 








CQ 








-J 





W 











-t/ 



<o, 



(35) 
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where k is defined as in (|27p . then the feedback gain matrix of the controller (|25p is given by K = 
WQ- 1 . 

Proof. The proof of the first part is similar to that of Theorem 3 and the proof of the second part 
is similar to that of Theorem 5. Both are omitted here for brevity. ■ 



5 Simulation Examples 



In this section, simulation examples are provided to validate the effectiveness of the theoretical results. 

Example 1. Consider a network of mass-spring systems with a common mass m but different spring 
constants, described by 

miji + kii/i = Ui, i = l,---,N, (36) 

where yi are the displacements from certain reference positions and ki, i = 1, • • • , N, are the spring 
constants, which are assumed to be in the form of 



h = k + Ak i: i = 1, ••• ,N, 



(37) 



where k$ is the identical nominal spring constant and Aki are the uncertainties satisfying \AkA < 5. 

l T 



Denote by Xi 



with 



Vi Vi 



the state vector of the i-th agent. Then, (|36p and (I37p can be rewritten as 

(38) 



.4 



x 


= (A + DAhE)x 


i + Bm 


i = 


= !,-•• 


N, 




l" 




~d 




' " 








rn _ 


,B = 


i 


,D = 


_ j_ 


,E = 


1 




Figure 1: The communication topology. 

The objective is to design a distributed controller Q such that the closed- loop network is quadrat- 
ically stable for all Aki. Let fco = 7N/m and m = 2.5kg. Solving the LMI (jlOp with 5 = 10 by using 
the Sedumi toolbox [36] gives a feasible solution: 



P 



1.6448 
-2.3499 



-2.3499 
9.7007 



64.0444. 



Thus, the feedback gain matrix is chosen as K 



0.1126 0.0788 



. Assume that the communication 



topology is given in Fig. 1, with only the first node knowing its own state. In let d\ = 2, and 
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dj = 0, i = 2, ■ ■ ■ , 6. Then, the minimal eigenvalue of the matrix C in is 0.237. Therefore, by 
Algorithm 1, the controller ([3]) with K chosen above solves the distributed quadratic stabilization 
problem for all Aki satisfying \Aki\ < 10, if the coupling strength c > 270.2295. The simulation result 
is depicted in Fig. 2, with c = 275 and Aki randomly chosen within the interval (7, 22]. 




Figure 2: The state trajectories of the agents (|38|) under controller ([3|). 

By solving the optimization problem (|14p . it is obtained that the maximal allowable 5 tends to be 
infinity. It is worth noting that a very large 5 generally implies a high-gain controller ([3]). For instance, 
the product of the feedback gain matrix K and the threshold cth corresponding to 8 = 1.5 x 10 5 is 



obtained as c t hK 



1.2558 0.0074 



10 5 . 



Example 2. The dynamics of the discrete-time agents are given by (|24j) . with 





1 


2 












0.8 






A = 





1 





,B = 


1 


,D = 





,E = 


1 




-1 





-0.6 




1 












The communication topology is given as in Fig. 1, with the first and last nodes knowing their own 
states. In (1251) . let d\ = 0.3, d§ = 0.5, and ofj = 0, i = 2, ■ ■ ■ ,5. Thus, the matrix T> in (I26D is 



V 



0.1 


0.15 


0.15 


0.15 


0.15 





0.15 


0.5 


0.35 











0.15 


0.35 


0.3 








0.2 


0.15 








0.1 


0.15 





0.15 








0.15 


0.5 


0.2 








0.2 





0.2 


0.1 



whose eigenvalues are -0.1611, -0.0644, 0.0959, 0.2257, 0.6316, 0.8722. Using the Sedumi toolbox [36] 
to maximize 5 in the LMI (|2T|) with n = 0.9 yields the largest allowable certainty bound <5 max = 2.5 
and the corresponding solution are as follows: 

98.2213 -2.0000 -61.3883 
p = -2.0000 0.1197 1.3573 
-61.3883 1.3573 86.2810 



W 



-0.0780 



-0.0612 



0.0912. 
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-0.0195 -0.9888 0.0009 



Thus, the feedback gain matrix of (|25p is obtained as K = 
trajectories of network (|26p are depicted in Fig. 3, with the uncertainties Fi randomly chosen within 
[-2.5,2.5]. 



The state 




200 

k 



250 300 350 400 



Figure 3: The state trajectories of (f2"o]) under controller 



6 Conclusion 

In this paper, the distributed robust control problems of uncertain linear multi-agent systems have 
been considered, where the agents are assumed to have identical nominal dynamics while subject to 
different norm-bounded parameter uncertainties. Distributed controllers have been designed, based 
on the relative states of neighboring agents and a subset of absolute states of the agents. It has been 
shown for both the continuous- and discrete-time cases that the distributed quadratic stabilization 
problems under such controllers are equivalent to the control problems of a set of decoupled linear 
systems having the same dimensions as a single agent. Algorithms have been further presented to 
construct the distributed controllers. An important yet challenging topic for future research is to 
extend the results of this paper to solve the consensus and formation control problems of uncertain 
multi-agent systems. 
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